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Abstract —We propose an iterative decoding method, which we 
call turbo-CS, for the reception of concatenated source-channel 
encoded sparse signals transmitted over an AWGN channel. The 
turbo-CS encoder applies 1-bit compressed sensing as a source 
encoder concatenated serially with a convolutional channel 
encoder. At the turbo-CS decoder, an iterative joint source- 
channel decoding method is proposed for signal reconstruction. 
We analyze, for the first time, the convergence of turbo-CS 
decoder by determining an EXIT chart of the constituent 
decoders. We modify the soft-outputs of the decoder to improve 
the signal reconstruction performance of turbo-CS decoder. 
For a fixed signal reconstruction performance RSNR of 10 dB 
we achieve more than 5 dB of improvement in the channel 
SNR after 6 iterations of the turbo-CS. Alternatively, for a 
fixed SNR of —1 dB, we achieve a 10 dB improvement in RSNR. 

Index Terms — turbo-coding, 1-bit compressed sensing, 
joint source-channel decoding, message passing de-quantization 


1. Introduction 

Sparse signals can be widely used and observed in different 
applications from astronomical and medical imaging to data 
collected by a group of sensors 0-0- The sparsity in such 
signals is effectively exploited in compressed sensing (CS) to 
retrieve a high dimensional sparse signal via a smaller number 
of measurements and to encode it to an arguably smaller 
number of values 0,0. In other words, compressed sensing 
can be categorized as a source coding method for sparse 
signals. In many applications those sparse signals are required 
to be transmitted to a receiver over a communication channel 
which is typically prone to errors. Therefore channel coding 
is also needed to protect the transmission of the bits against 
the channel errors. It has been proven that under idealistic 
asymptotic conditions, where both source and channel codes 
are assumed to be of infinite length and complexity, optimal 
performance is achievable via separate source and channel 
coding. In practice, however, source coding usually leaves 
some redundancy in the representation of the signal. Joint 
source-channel decoding is provably optimum under such cir¬ 
cumstances, where the residual redundancies from the source 
coding can be jointly used with redundancies introduced by 
the channel code to correct the channel-errors 0,0- 

In this work, we consider a single-transmitter single-receiver 
communication system for transmission of sparse signals over 
an AWGN channel. We propose an iterative (turbo) method 
which we refer to as turbo-CS. The turbo-CS encoder consists 
of a 1-bit CS encoder, 0,0, as a source encoder concate¬ 
nated serially with a convolutional channel encoder. In other 
words, the inner encoder in serial concatenated convolutional 
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code is replaced with a 1-bit CS encoder. We introduce an 
iterative source-channel decoder where the process of decom¬ 
pression is performed within the loop of a turbo-decoder cycle. 
It should be noted that apart from the high performance of 
the proposed decoder due to the aforementioned reasons, the 
computational complexity vs. performance of our system is 
expected to be significantly better than a separate system of 
concatenated CS decoder and a turbo decoder. 

The term ‘turbo’ refers to the approach of turbo-codes where 
two decoders at the receiver exchange a posteriori / a priori 
information through a number of iterations to improve the 
decoding process |TQ|-|T^. Turbo-CS decoder applies an a 
posteriori probability (APP) decoder as channel decoder and 
soft-in/soft-out (SISO) 1-bit CS decoder as the source decoder. 

This paper is a substantial extension of our previous work 
in (H) where we have introduced the basic model of turbo- 
CS decoding system. In SISO 1-bit CS decoder in O’ 
a heuristically chosen linear mapping function provides a 
priori information for APP decoder to be used in the next 
iteration of the turbo-CS decoder O Since the proposed 
mapping method is based on a heuristic conversion function, 
its output bit probabilities are not of the proper distribution to 
be fed to the APP decoder as input. Consequently, despite the 
relatively good performance of the proposed system it is yet 
considerably sub-optimal. Also, (ID lacks a solid analysis on 
the performance of the system, again because of the heuristic 
mapping function used. 

The key contribution of this work is to introduce a new 
SISO 1-bit decoder which is based on message passing de¬ 
quantization (MPDQ) method in CD- MPDQ applies Gaussian 
approximation to solve a loopy belief propagation problem. 
The input of MPDQ is quantized version of noisy CS mea¬ 
surements. This method reconstructs the sparse signal by 
estimating the mean and variance of the signal elements 
from which the bit probabilities we are looking for can be 
derived. In a special case when the quantizer has two levels, 
the MPDQ algorithm converts to 1-bit CS reconstruction 
method using Gaussian approximation. We propose SISO 1-bit 
MPDQ algorithm whose input and output are soft-values. The 
SISO 1-bit MPDQ is a tractable algorithm and its output bit 
probabilities are matched with the required bit probabilities by 
APP decoder. Therefore, we can analyse the performance and 
convergence of the turbo-CS decoder using extrinsic transfer 
(EXIT) chart. Moreover, we consider a more general class of 
Bemoulli-Gaussian signals in this work (in comparison to the 
model in p3| ) where the sparsity level of the signal is also 
stochastic and unknown to the decoder. 

This paper is organized as follows: a summary of related 
background is provided in Section |I^ In Section |I^ we 
explain turbo-CS and channel transmission model. In Section 
[Tvl we introduce turbo-CS decoder for the system model of 
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Section|I^ The EXIT chart analysis of the turbo-CS decoder is 
presented in Section [V] The performance of turbo-CS through 
numerical experiment is investigated in Section |Vl| The paper 
is concluded in Section [ 


IT Related works 

In this work, compressive sensing is applied in the context 
of joint source-channel decoding. CS has been introduced in 
0, GD and extensively studied |T^ . The number of CS 
measurements can be reduced in the presence of a statistical 
characterization of the signal where Bayesian inference offers 
the potential for more precise estimation of signal |T7), (Tg. 
In |T9| , a belief propagation (BP) decoder has been developed 
to accelerate CS encoding and decoding under the Bayesian 
framework. To overcome the computational complexity of BP 
a Gaussian approximation is applied to CS decoding in p0| . 

In practical applications, the CS measurements are quan¬ 
tized to finite symbols for storage and transmission purposes 
ED, 1^ . Gaussian approximation of BP, referred to MPDQ, 
has also been effectively applied in quantized compressed 
sensing (T4). The SISO source decoding method introduced in 
our paper is inspired by MPDQ. However, we have modified 
MPDQ to accept and provide soft-values (probabilities) as 
input and output. 

A wide range of joint source-channel decoding schemes 
has been proposed in the literature. Here, we list few mostly 
relevant works to ours (see Q for an extended survey). In 
(231 , EXIT chart analysis has been used to design an iterative 
source-channel decoder. Statistical characteristics of hidden 
Markov sources have been used to modify a turbo decoder for 
joint source-channel decoding Optimal vector quantizer 
has been incorporated as a channel encoder jointly with CS 
encoder for sparse signal transmission over AWGN channel 
In a paper by Schniter, BP has been applied in an iterative 
approach for reconstruction of structured-sparse signals | [26| . 

HI. System model 

In this section we explain turbo-CS encoding model. We ap¬ 
ply concatenated coding scheme consisting of the combination 
of two constituent encoders. Turbo-CS encoder includes a 1- 
bit CS encoder (as a source encoder) and a channel encoder to 
form a serial concatenated source-channel encoder. The input 
of turbo-CS encoder is a sparse signal. 


A. Sparse signal model 

We denote a block of sparse signal with x G Signal 
X is called if-sparse when K elements out of N elements 
are non-zero. In this work, we consider a case where K is 
stochastic and the probability of an element being non-zero is 
known and fixed to p. We assume that the elements of x are 
independent and identically distributed (i.i.d) and generated 
from the following Bemoulli-Gaussian distribution: 

ffO’ o) ’ probability p, 

Xi^ < V (1) 

[0, with probability I — p 


where Xi denotes ith element of vector x. Therefore, the 
probability density function (PDE) of Xi is 


(x) = P 



+ {1- p)S (x). 


The PDE of a signal block is obtained from 


( 2 ) 


N 

Px (x) = tJPa;; (a;*) • (3) 

i=l 


B. 1-bit compressed sensing 

In classic CS, the sparse signal x is measured through a 
few number of linear measurements. The measurement vector 
y is obtained by multiplying signal vector x with matrix 
^ G The elements of ^ are i.i.d. zero mean Gaussian 

random variables with variance 1/M and the output of CS is 

y = ^x. (4) 

It is shown that matrix ^ satisfies the restricted isometry 
property (RIP) which guarantees signal reconstruction with 
high probability ED- In quantized CS, for further storage 
and transmission purposes, the measurements are quantized 

to a number of alphabets. In addition, the noise of the 

measurement/quantization is modelled by an additive Gaussian 
noise ED- We denote the measurement/quantization noise by 
vector e where ^ A/' (O, dg) for all i. We denote a scalar 
quantization function with Ql : M -> that maps real-valued 
CS measurement to discrete alphabet T with \1F\ = L. 

1-bit CS is a special case of quantized CS where L = 2 

and T = { —In fact, 1-bit quantizer is a simple sign 

function. We denote the block of the 1-bit CS measurements 
by b G { — nnd 1-bit quantizer with Q 2 , hence, we 
have 

0.2 (y + e) = sign (y + e) = b. (5) 

Since in CS M < N, it can be generally considered as a 
compression method. In particular, we are interested in 1-bit 
CS as the outputs are in the form of bits and therefore can be 
interfaced to conventional channel encoders. 

C. Concatenated source-channel encoder 

We consider the serial concatenated source/channel en¬ 
coding transmission scheme of Eigure The signal x is 
compressed to b by a 1-bit CS encoder with compression 
rate N/M. We denote the bit energy by E^, as a measure 
of transmission power. In the next step, a channel code of rate 
M/P expands the block of 1-bit CS measurements b to a 
sequence d of size P. 

In classic turbo encoder system models where two channel 
encoders are concatenated an interleaver is used between the 
two encoder at transmitter due to the correlation in the two 
encoding processes ED However, since in our scenario there 
is no correlation between source and channel coding, we 
confirmed through experiment that utilization of an interleaver 
does not improve the performance of the turbo system. In this 
work, we restrict our consideration to convolutional codes. The 
individual code bits pi are BPSK-modulated with bit energy 
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1-bit CS encoder AWGN 



Fig. 1. Turbo-CS encoding: serial concatenation of 1-bit CS encoder and a 
convolutional encoder. Coded bits are transmitted over an AWGN channel 


Ei)M/P and transmitted over a memoryless AWGN channel 
with noise spectral density A^o = 

For simplicity, we assume that the measurement and quan¬ 
tization process in 1-bit CS is error-free and, therefore, there 
is no measurement/quantization noise in § (cTg = 0). As 
illustrated in Figure the only source of the noise in turbo- 
CS setup is the channel noise. 

The remainder of the paper is devoted to design and analysis 
of an iterative joint source-channel decoder for the above 
transmission model. In the next section, we explain a turbo¬ 
decoder to reconstruct the signal from noisy turbo-CS encoded 
bits. 


IV. Turbo-CS decoder 

In this section, we propose an iterative joint source-channel 


decoder for mentioned transmission system in Section III 


which we refer to as turbo-CS decoder. Turbo-CS decoder 
consists of two main parts: an APP decoder as the inner 
component decoder and a 1-bit CS decoder as the outer 
component decoder. 


refers to a priori LLR values at the input of APP decoder 
(channel decoder). 

The aim with the turbo-CS decoder is to apply a SISO inner 
component decoder that updates the extrinsic LLR values, 
, from APP decoder. Then the updated LLR values are 
passed to APP decoder as a priori LLR values, , for the 
next decoding iteration. 

Thus, the inner decoding component should be in the form 
of SISO 1-bit CS decoder. In the following section, we propose 
a SISO 1- bit CS decoder as the inner decoder component of 
turbo-CS decoder. 


B. Bayesian formulation of soft-in/soft-out 1-bit CS decoding 
problem 

In this section, we derive Bayesian formulation of SISO 1- 
bit CS decoding problem for turbo-CS decoding. In the first 
step, we focus on a transmission case where there is no noise 
in the channel. Therefore, the convolutional encoder in Figure 
[T]can be removed and we have z = b where b is obtained from 
0- As mentioned in the previous section, we assume that the 
measurement/quantization process is error-free and (7^=0. 
Hence, conditional PDF of the signal x given the received b 
is 

IPx|b(x|b) oc Pb|y(b|y)Px(x) (8) 

M M 

a l[n\y{bi\yi)l[P,^{xi) (9) 


A. A posteriori probability decoder 

An APP decoder is a soft-in/soft-out (SISO) decoder | [28l . 
The APP decoder accepts two inputs: 1) the received signal z 
from the noisy channel and 2) the a priori probabilities of the 
bits. The latter is provided from the outer constituent decoder 
(in our case the 1-bit CS decoder) and in the form of soft- 
values. The soft-value is a convenient method of providing 
information about the sign and reliability of a bit. Specifically, 
the sign of a soft-value indicates the most likely sign of the 
bit and the magnitude gives the probability that it is correct. 
Soft-values can be in the form of log likelihood ratio (LLR) 
p^ . Given the probability of a bit, b G { — 1,+!}, LLR of b 
is defined by 


A := log 


( n(+i) \ 

L-Pfe (+1)7 


( 6 ) 


The logarithm in ([^ is natural logarithm. In the same way, 
the probability of b given A is calculated by 


n (+1) = 


l^ tanh(f) + 1 j 


(7) 


APP decoder applies BCJR algorithm which generates APP 
of the states and transitions of a discrete time finite-state 
Markov process pQ| . The output of APP decoder is in the form 
of extrinsic LLR values. We denote the vector of extrinsic LLR 
values at the output of APP decoder with In addition. 


where oc denotes equality after normalization to unity. Since 
there is no measurement/quantization noise, we have 


where 


Pbiy 


1 , ifyieQ2^{bi), 
0 , yi 7 Q2^ (bi) ■ 


( 10 ) 


Qy (b) 


[0,+oc), if6 = +l, 
(—(X), 0), b = —1. 


The distribution in 0, describes the complete statistical 
characterization of the decoding problem. The minimum mean 
square error (MMSE) estimator of x is obtained from the 
following 


xmmse (b) = E (x|b). (12) 

As shown in Figure due to the channel noise there is 
uncertainty in received signal z and after channel decoding, 
the APP decoder provides probability of bits instead of fixed 
b. We have 

M 

Pb'‘’(b) = (13) 

i=l 

where for each element of b is obtained from ([^. 
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Therefore, the decoding problem for the SISO 1-bit CS 2) Linear factor update functions: 
decoder is the estimation of x given the bit probabilities in 

From the law of total expectation we have (t) — (^ • ^) (t — 1) (15) 


E (xMMSE(b)) = ^E (x|b) (b) = E (x) = X (14) 

all b 

where x denotes the estimate of original signal x via 1-bit 
SISO decoding. In other words, in turbo-CS decoder, the 
output LLR-values of APP decoder are input as soft- 
values to SISO 1-bit CS decoder. As the next step, SISO 1-bit 
CS decoder estimates original signal x from through an 
estimation method. A popular iterative computational method 
to approximate the MMSE estimator xmmse is loopy belief 
propagation (LBP) (H) However, implementation of LBP 
for de-quantization problems when matrix $ is not sparse is 
highly computationally complex. LBP requires computation of 
high-dimensional distributions at measurement nodes which 
makes its application impractical in de-quantization problems. 
In the next section, we explain SISO 1-bit CS decoding algo¬ 
rithm which solves ( p^ using Gaussian approximate message 
passing technique p0| , p2| , 


C. Soft-in/soft-out 1-bit message passing de-quantization 


As discussed in section IV-B| due to high complexity, imple¬ 
mentation of MMSE estimator in ( p^ using belief propagation 
techniques is not possible. Recently, Kamilov et al introduced 
message passing de-quantization (MPDQ) algorithm to solve 
® (T4). MPDQ is based on the Gaussian approximate 
message-passing algorithm referred to as generalized approx¬ 
imate message passing (G-AMP) p0| . 

In the following, we modify MPDQ to estimate the original 
signal X to X in ( p^ . The proposed SISO 1-bit CS decoder (as 
the inner component of turbo-CS decoder) applies the modified 
version of MPDQ to estimate the original signal x jointly with 
APP decoder through turbo-iterations. 

We have modified two parts in MPDQ: 


• We change the non-linear factor update functions and 

adapt them to accept the probability of the bits as input. 
The input bit probabilities p{^^^^(b) are obtained from 
a priori LLR values given to SISO 1-bit CS decoder 
denoted by vector (a priori LLR values for source 

decoder). 

• We extend the algorithm to provide bit probabilities at 
the output of MPDQ (for the a priori input of the APP 
decoder on the next iteration). We denote the related LLR 
values at the output of MPDQ by vector . 

Here, we explain MPDQ algorithm including the modified 
steps: 

1) Initialization: The initial expected and variance vector 
are set with respect to prior distribution of x in Q. Therefore, 
x(0) = E (x) = 0 and v^(0) = var (x) = 1 where the number 
inside the parenthesis denotes the number of corresponding 
iteration and 0 and 1 denotes all-zero and all-one vectors 
respectively. We set initial value for the intermediate variable 
s(0) = 0. 


p (t) = $x (t - 1) - (t) • s (t - 1) (16) 

3) Non-linear factor update functions: 

Si (t) = Sf 

< (^) = Vf 'Pi (^) ’ (^)) 

where • denotes element-wise multiplication and fp and Vp 
are functions over scalar values: 

£F{F,{b),p,vP) = ^{E{z)-p) (19) 




( 20 ) 


where we have a priori distribution z ^ J\f {p^v^). The non¬ 
linear functions fp and Vp are the modified versions of updat¬ 
ing factor functions in (T4). In fact, these modified functions 
allow a more general input model where all quantization 
symbols for each factor are possible as input with different 


probabilities. The expectation and variance in (19) and (20) 
are calculated as follows: from the law of total expectation 
we have 


E(^)= ^ ¥i,{b)E{z\zeQ^\b)). (21) 

6=-l, + l 

In addition, from the law of total variance we obtain 

var( 2 :) = E^ (var (z|6))-f var^ (E (zj^)) = 

= Eb (var (^16)) + Eb (e (^16)^) - E {zf (22) 


where 


Ef, (var( 2 :|&)) = ¥b{b)\ar{z\z e Q 2 ^{b)) (23) 

6=-l,+l 


Eb(E(z|6)2)= y] ¥b{b)E{z\zeQ2Hb)f. (24) 

6=-l, + l 

We refer the reader to p4| for calculation of the expectation 
and variance of the truncated Gaussian distributions in ID. 
ID and ID- 

4) Linear variable update functions: 

v’-(t)= (25) 

r(i) = x(i-l)+v’’ (t). 


(26) 
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5) Non-linear variable update functions: 

Xi (t) = Sy {fi (t), vl (t)) (27) 

vf {t) = Vv (fi {t), v[ (t)) (28) 

where Ey and Vv are functions over scalar values and we have 
£y (f, = E {x\r) (29) 

and 

Vv (f, = var {x\r ). (30) 

The above expected value and variance are with respect to 
r = X ^ w where w ^ A/’(0, v^). 

6) Termination of iterations: Then, f ^ t + 1 and proceed 
to step 2) until convergence criterion is satisfied or t reaches 
the maximum iteration number. Therefore, through above 
updating steps MPDQ estimates x of original signal x through 
inner iterations. 

7) Soft-output: The term ’soft-output’ refers to the updated 
bit probabilities at the output of SISO 1-bit CS decoder. To 
update the bit probabilities, we need to find the distribution of 
the estimate of y. We can approximate the distribution of the 
estimated elements of original signal x with mean and variance 
of X in ( [29| ) and ( [30| ). Since y is a linear combination of x, 
the estimate of original y is obtained from 

y = E(y) = ^x. (31) 

and 

= var (y) = (^ • ^) (32) 

where each element of the estimated y has approximately 
Gaussian distribution with the mean and variance in •HU 
and ( [3^ . Hence, we can update the probability of each 
corresponding bit at the output of SISO 1-bit CS decoder 
which is denoted by The updated bit probabilities are 

calculated from 

= (33) 

where Q (x) = exp Then the updated bit 

probabilities are converted to LLR values via and form 
vector (extrinsic LLR values of source decoder). We 

refer to the mentioned algorithm as SISO 1-bit MPDQ. 

D. Combination of APP decoding and soft-in/soft-out 1-bit 
message passing de-quantization 

In Turbo-CS decoding, APP decoder and SISO 1-bit MPDQ 
are applied as inner and outer decoder components respec¬ 
tively. In each iteration of turbo-CS decoder, the APP decoder 
decodes each block of received signal z to provide extrinsic 
LLR values, These extrinsic values are given to SISO 

l-bit MPDQ as SISO 1-bit MPDQ through number 

of inner iterations estimate signal block x and updates bit 
probabilities from ( [^ . The updated bit probabilities (b) 


I{b;A) = l- Y. PA|6(A|6)log 

6=-l, + l 



Fig. 2. Turbo-CS decoding: APP decoder and SISO 1-bit MPDQ decoder 
are iteratively estimate signal x by exchanging LLR values 

are converted to and given to APP decoder as for 

the next turbo-iteration. Turbo-CS decoder, estimates original 
signal X with x through several turbo-iterations (Figure [^. In 
the first iteration of turbo-CS, there is no a priori information 
available at the input of APP decoder and a priori bits are 
equiprobable, hence, is initialized with all-zero vector. 

V. Analysis of turbo-CS decoder 
A. EXIT chart for iterative processes 

Extrinsic information transfer (EXIT) chart is a popular and 
powerful tool for analysis and prediction of the convergence 
behaviour of iterative techniques p5|-p7|. In this section, we 
briefiy review the EXIT chart approach. We refer the reader 
to pS] for comprehensive explanation of EXIT chart. 

In an EXIT chart, each constituent decoder of the turbo 
process is presented by an EXIT function. The EXIT function 
describes the relation between input/output of each individual 
decoder by applying mutual information measure T (•; •) from 
Eor constituent decoders of turbo-CS scheme we have: 

• APP decoder: 

lg"> = I (l,; Afe’l) ^ ife" = I [b; Ag) 

• SISO 1-bit MPDQ decoder: 

l“ = I (l,; Agl) ^ ig" = I {b; aI“I) 

The EXIT functions for 1-bit MPDQ and APP decoder 
are illustrated in Eigure Here, we apply a corresponding 
APP decoder of a rate 1/3 recursive systematic convolutional 
channel encoder . The code polynomials areG= 

Note that the EXIT function for APP decoder depends on 
the quality of channel because Fz\d{z\d) is considered in 
determination of We define signal to noise ratio 

2Ea|6(A|^) 

^A\b (A| — 1) + Ea|6 (A| + 1) 


( 34 ) 
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Fig. 3. EXIT chart of turbo-CS receiver at SNR= —1 [dB] 


Fig. 4. Input probability vs. modified probability at the output comparing 
the Genie aided results with our proposed transform function (M=500, T=5) 


(SNR) as the channel noise measure by 

SNR = ^ = 4 (34) 

No cr2 

where is the average power of a bit at the output of 1- 
bit CS encoder. We set SNR = — 1 dB and bit block size 
M = 500. The EXIT functions are measured individually 
while the decoding trajectory is measured in the actual turbo- 
CS configuration. In Eigurej^ the decoding trajectory is shown 
for 3 turbo-iterations by the circled line. The decoding tunnel 
between two EXIT functions indicates that turbo-CS decoder 
might converge after number of iterations. 

As it can be seen, the decoding trajectory undershoots the 
APP EXIT curve. In classic EXIT chart, the undershooting 
(overshooting) effect can result from a too small signal block 
size 1351 • However, this is not the case in turbo-CS scheme as 
there is no correlation between the inner and outer component 
coding systems. Hence, there is no interleaver applied in turbo- 
CS and the signal block length does not affect the turbo¬ 
decoding performance. In our case, the undershooting effect is 
due to the mismatch between the output LLR values of SISO 
1-bit MPDQ, and input LLR values of APP decoder, 

. In fact, the EXIT functions in Eigure are obtained 
though individual classic configuration where and 
are modelled with the following random process : 

A = fiAb + riA (35) 

where nA ~ V (0, (tX) and /iA = cr^/2 ^5^ . However, the 
obtained A 3 ^^^ in actual configuration (trajectory) does not 
have the same random Gaussian characteristic as in ( [35] ). The 
reason behind this mismatch is the approximation applied in 
generation of soft-output values in SISO 1-bit MPDQ in ( [3T] ), 
^ and 

In the next section, a training-based modification method 
will be introduced which maps A^^^^ to true LLR values. 



Fig. 5. Input probability vs. modified probability at the output comparing 
the Genie aided results with our proposed transform function (M=500, T=50) 


B. Modification of a priori LLR values 

To obtain true LLR values from we consider the 

following characteristic of LLR values generated from ( [^ 


A = log 


/ Pa|6(A| + 1) \ 

VPa|5(A|-1); 


(36) 


This property of LLR values gives us a benchmark to 
investigate the accuracy of the obtained probabilities from 
( [^ . In other words, if the corresponding bit probabilities, 
]P^^^(6), were true then A^^^^ would satisfy the property in 

(Hj. 


Accordingly, we calculate the right-hand side of ( [33] ) and 
denote the result LLR values (left-hand side) by The 
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obtained values of are true LLR values that need to be 

given to APP decoder as Determining the conditional 

probability values in ( [36| ) requires knowledge of original 
output bits of 1-bit CS encoder, b, at receiver. Here, we apply 
a T block of training bit sequences which is predefined to 
both transmitter and receiver parts. For simplicity, we derive 
a modification function for bit probabilities rather than LLR 
values as probabilities have a bounded magnitude. The fiow 
of modification process is as follows: 


pjapri] ^[ext] ^ [mod] |p[mod] 


SD 


A 


SD 


pimodj 


(1) The obtained bit probabilities in ( [33] ) are mapped to A^^^^ 
from (|^. 

(2) A^^^^ are modified to by using training bit se¬ 

quence in ( [3^ . The conditional probabilities in ( [3^ are 
calculated from samples and training bits. In this 
fashion, A^^^^ are grouped in a number of histogram 
bins. Therefore, the precision of conditional probabilities 
depends on the number of training blocks, T (Figure 
andj^. 

(3) Modified LLRs are mapped to modified bit probabilities 
from (0. 


The modification scatter diagram of bit probabilities is 
illustrated in Fig ure and [^ for the first iteration of turbo-CS 
setup in Section V-A and for T = 5 and T = 50 respectively. 
Comparison of these two figures indicates that accuracy of 
( [36| ) through numerical calculation depends on the number of 
samples (training bit blocks). According to Figure and [^ 
the relation between (5) and (5) can be described 

by a shifted tangent hyperbolic function. Tangent hyperbolic 
function has also been applied as a tentative device for soft- 
decision making in iterative multi-user code-division multiple 
access decoders | |3^ . 

We consider the following heuristic model as a probability 
transform function: 


tanh (a (+1) - O.sfi + 1 

p[modl ^ ^ ^ ^ ' - 12 - (37) 

where a is a tuning factor defining the slope of the function. 
The tuning factor need to be optimized through training 
sequence for each turbo-CS iteration number. A numerical 
non-linear regression method can be applied to find a for each 
turbo-CS iteration with input training bit sequence. In this 
work, we use Levenberg-Marquardt nonlinear least squares 
algorithm as a method of curve fitting | |3^ . 

We obtain optimized a for 3 turbo-iterations through T = 
50 blocks of training bit sequence with block size M = 500. 
The decoding trajectory of turbo-CS decoder with refined 
SISO 1-bit MPDQ is depicted in Figure With this prob¬ 
ability refinement, the coding trajectory matches the EXIT 
functions. 

VI. Performance of turbo-CS decoder 

In this section, we briefiy investigate the performance of 
turbo-CS decoder. We assume that signal x G is generated 



Fig. 6. EXIT chart of turbo-CS receiver with modified output probabilities at 
SNR= —1 [dB]. To obtain EXIT trajectory is used instead of 



SNR [dB] 


Fig. 7. Performance of turbo-CS decoder for 6 iterations and for different 
SNR scenarios {N = 1000, M = 500, p = 0.01) 


based on the distribution in ([T]) where N = 1000 and p = 0.01. 
The measuring matrix is $ G with i.i.d zero-mean 

Gaussian entries with variance 1/M where M = 500. Note 
that ^ is known by the turbo-CS decoder. 

We apply a recursive systematic rate 1/3 convolutional 
encoder with polynomial coefficients G = (l, f|)g as the 
channel encoder. The coded bits then pass through an AWGN 
channel. 

For turbo-CS tuning purpose, a sequence of T = 50 
predefined bit-blocks are input to the channel decoder. For 
each SNR the tuning factor a in ( [TT] ) is derived for 6 turbo- 
CS iterations. 



























Then turbo-CS receiver is applied to reconstruct the signal 
through 6 turbo-iterations. The maximum number of inner 
iterations is set to 100. We measure the performance of the 
signal reconstruction by received signal to noise ratio (RSNR) 
which is defined by 



where ||x ||2 denotes the Euclidean norm of vector x. 

Figure illustrates the performance of turbo-CS receiver 
for 6 iterations over 4000 Monte Carlo realizations for differ¬ 
ent SNRs. As it is depicted in the figure, turbo-CS decoder 
improves the quality of reconstructed signal by more than 10 
dB at an SNR of — 1 dB in comparison to non-iterative decoder 
(first iteration). Considering a fixed RSNR, we improved the 
SNR range by more than 5 dB when the turbo-CS decoder 
has converged (above RSNR of 10 dB). 

What we can also notice here is the typical turbo-decoder 
effects; Firstly, over iterations the performance improvement 
diminishes. Secondly, the slope of the curve is much steeper 
than our previous paper creating a turbo-cliff perfor¬ 

mance where the system either converges or it does not. 

VIL Conclusion 

In this paper, we introduced a serial concatenated encoding 
scheme with an iterative source-channel decoding method. The 
system model is designed for transmission of sparse signals 
over an AWGN channel which we refer to as a turbo-CS 
encoder. We proposed SISO MPDQ as a soft-in/soft-out source 
decoder that can be concatenated with an APP decoder to 
decode sparse signals in an iterative fashion, which we refer 
to as turbo-CS decoder. 

We have shown, for the first time, the EXIT chart analysis 
of the turbo-CS decoder, we modified the soft-outputs of SISO 
MPDQ to be of the correct distribution required by the APP 
decoder. 

We considered the case where the sparsity level of the 
transmitted signal is stochastic and unknown to the turbo-CS 
decoder. The numerical experiment shows more than 10 dB 
improvement in the signal reconstruction performance (RSNR) 
can be achieved (at a channel SNR of —1 dB) over the 
non-iterative (first iteration) decoder. Alternatively, more than 
5 dB of channel SNR can be improved for a fixed signal 
reconstruction performance of RSNR= 10 dB. 
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